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Two  Worlds 


Analytic  Simulations 

■  Execution:  Typically  As-Fast-As-Possible 

■  Objective:  Quantitative  Analysis  of  Complex  Systems 

■  Human  or  System  Hardware  Interactions:  None 

LVC  Simulations 

■  Execution:  Distributed  Real-time 

■  Objectives:  Training,  Human  Factor  Studies  &  Strategy 
Evaluation 

■  Human  or  System  Hardware  Interactions:  People  and/ or 
Hardware  Integral  to  Controlling  the  Behavior  of 
Entities 


Hardware  Topologies 


Analytic  Simulations 
Typically  Use  Low  Latency 
Interconnects 


LVC  Simulations 

Typically  Use  Relatively 
High  Latency  Interconnects 
(S-lOOms  or  More) 


Anatomy  of  an  LVC  Simulation 


Logical  Process 


Logical  Process 


Network 


Simulations  or  Logical 
Processes  Share  State  Data 
;via  DIS,  HLA,  TENA,  etc) 


Logical  Process 


Logical  Process 


Characteristic 


Requirement  or  Result 


Human  and/ or  System 
Hardware  in-the-Loop 


Geographically 
Distributed  Systems 


Real-time  Response  and 
Execution 


Fundamental 
I  Conflict! 


Relatively  High  Latency 
to  Move  Shared  Data 


Fundamental  Conflict 


Logical  Processes 

■  Require  State  Data  that  is  Not  Locally  Managed  to  Produce  Correct 
Outputs 

■  Cannot  Wait  for  the  Most  Current  Value  and  Still  Meet  Interactive 
Response  Time  Requirements 

■  Must  Advance  Time  with  Wall-clock  (i.e.,  Real-time) 

■  If  Network  Exhibits  a  Relatively  High  Latency,  Data  Transmitted  by 
One  Logical  Processes  Might  be  Inconsistent  and  “Old”  by  the  Time 
it’s  Received  by  Another 

Distinguishing  Characteristic  of  LVC  Simulations 

■  Inconsistency  in  Shared  State  Data 

■  Value  of  Distributed  Data  Objects  are  Not  Equal 


Distributed  State  Space  (Data) 


Each  Logical  Process  (LPO,  LPl  and  LP2)  Locally 
Manages  Part  of  the  Simulation  State  Space  (Data), 
While  Replicating  Others 


Performance/ Scalability 

Relaxing  Absolute  Data  Consistency 
Improves 

■  Performance 

■  Measure:  Interaction  Response  Time 

■  Scalability 

■  Measure:  More  Logical  Processes  from  More  Distant 
Geographic  Locations  can  be  Connected 


Measuring  Inconsistency 

Measured  in  Terms  of  Age 

■  Time  Since  Data  Object  Last  Computed  by 

■  A  System  Model  (Ex:  Updating  the  Position  of  Aircraft) 

■  Sampled  from  the  Real  World  (Ex:  Value  Sampled  by  a  Real  Sensor) 

The  Age  of  Data  Affects  Accuracy  /  Correctness  of 

■  Continuous  Quantities 

■  Discrete  Quantities 

should  Be  Considered  in  the 

■  Design  of  LVC  Simulations 

■  Analysis  of  Results 

Result:  Manifests  Itself  as  Error 


Consistency  Model 

Any  Notion  of  Data  Quality  of  Correctness 
Depends  on  the  Actual  Use  of  the  Data 

We  are  Interested  in  Accuracy  and  Timeliness  and 
Their  Relationship  to  Data  Values  that  Change  in 
Real-time  (i.e.,  Temporal  Data) 

A  Temporal  Consistency  Model  Defines  the 
Correctness  of  Real-time  Data  Objects  in  Terms  of 
Time 

Temporal  Consistency  Model  Relaxes  Absolute 
Consistency  by  Assigning  a  V alidity  Interval 


Validity  Interval 

Temporal  Consistency  Theory  Assigns  a  Time 
Period  or  Validity  Interval,  V,  to  Each  Data  Object 
0,  for  which  the  Value  is  Considered  Correct 

Example: 

■  Consider  a  Data  Object,  0,  that  Represents  the  Position 
of  an  Entity  at  Time  Tq 

■  Data  Object,  0,  Would  be  Considered  Correct  Until 

(To+V) 

■  Until  time  (Tq  + V),  the  System  is  Considered  to  be 
Temporally  Consistent 


what  About  Error? 


The  Amount  of  Acceptable  Error  is  a 
Function  of  Simulation  Requirements 

Acceptable  Error  is  Used  to  Define  Interval 

Example: 

■  Requirement:  Acceptable  Error  for  the  Position 
of  an  Entity  is  + 1  mile 

■  Entity  Position  Max  Rate  of  Change:  60 
miles/hour 

■  Validity  Interval  Determined  to  be  1  minute 


Continuous  vs  Discrete  Data 

Continuous  Data 

■  Can  Use  Acceptable  Error  and  Average  Rate  of  Change 
to  Determine  Interval 

■  Data  Quality  Focused  on  Accuracy 

Discrete  Data 

■  Validity  Interval  is  Not  Fixed 

■  Data  Quality  Focused  on  Timeliness 

■  Replicated  Data  is  Simply  Incorrect  Until  Update 
Received 

■  Impact  of  Temporally  Incorrect  Discrete  State  Data  Must 
Be  Evaluated 


Estimating  the  Age  of  Data 

Sources  of  Inconsistency 

■  Simulation/Logical  Process  Architecture 

■  Network  Latency 

Example 

■  EaaGLES  Architecture  Characterized 

■  Network  Latency  can  be  Estimated 

Metrics 

■  Determination  of  Mean  Age  and  Variance  of  Overall 
System  Design 


Application 


To  Ensure  95%  Temporal  Consistency 


i 


Mean  +  1.96  StdDev 


<  V alidity  Interval 


Conclusion 


LVC  Simulation  Use  Inconsistent  Data 

Relaxing  Absolute  Consistency  Improves 
Simulation  Performance  and  Scalability 

Inconsistency  is  Directly  Related  to  Error 

Acceptable  Errors  can  be  Used  to  Determine 
Validity  Intervals  (Max  Data  Age  Tolerated) 

Simulation  Systems  Should  be  Carefully  Partitioned 
and  Designed  to  Ensure  Correct  Operation 


